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(57) Abstract 

A thn^mensional surface contouring method is based on the full-field fringe projection technique A digital video projection 
system (18) is used to project digitally created fringe patterns onto the object (12). The fnnge pattern distorted by toe geometry of the 
ot^TsLfie (14) is then ^tun^ by a high resolution CX:D camera (20). To increase contouring resolution purely softovare-based d.^ 
phLe shifting technique is used, which elimir«tes the need for accurate positioning systems in the traditional phase shifting methods. The 
surface (14) is reconstructed by applying the phase wrapping and unwi^ping algorithms. 
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] V| f THOD AND APPARATUS FOR THREE DI MENSIONAL SURFACE 
rONTOURING USING A DIGITAL VmEQ PR O^TFrTION SYSTEM 

This application claims the benefit of U.S. Provisional Application 
No.60/070,138, filed December 31, 1997. 

STATEMEN T OF GOVERNMENT RIGHTS 

This invention was made with Government support under grant No. DMI 
9713895 provided by the National Science Foundation. The Government has certain 
rights in the invention. 

BACKGROUND O F TTTE INVENTION 

The presCTit invention relates generally to a method and apparatus for three 
dimensional surface contouring. In particular, the present invention uses a digital 
video projection system for digitally generating fiinge patterns in three dimensional 
surface contouring. 

Three dimensional surface contouring techniques have numerous applications 
in design and manufacturing. For example, surface contouring can be used for 
inspection of industrial parts whose dimensions and geometry need to be checked 
against their design specifications during or after manufacturing. These techniques 
can also be used in reverse engineering where construction of a Computer Aided 
Design (CAD) model firom a physical part is required. In recent years, rapid 
prototyping technology based on a layered manufacturing concept has been 
established which allows for rapid fabrication of physical concept models, fimciional 
parts, and toolings directly fix>m CAD models. Surface contoiuing techniques can 
help extend the capabilities of current rapid prototyping systems to include building 
physical parts and toolings fix)m hand-crafted models or parts for which a CAD model 
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is not available. Surface contouring techniques can also help improve the accuracy of 
constructed models by introducing in-process or post-process inspection into the rapid 
prototyping process. 

Many optical three dimensional contouring methods have been developed and 
are well known in the art. The methods can generally be categorized into two groups: 
scanning and non-scanning imaging techniques. (Bieman, Leonard H., "Survey of 
design considerations for 3-D imaging systems," Proc. SPIE, Vol. 1005, 138-144 
(1998)). The scanning techniques are represented by point triangulation (Blais, F. and 
Rioux, M., "BIRIS: a simple 3-D sensor," Proc. SPIE, Vol 723, 235 (1986)), laser 
radar (Svetkoff, DJ., Leonard, P.F., and Sampson, R.E., 'Techniques for real-time, 3- 
D feature extraction using range information," Proc. SPIE, Vol. 521, 302 (1984)), and 
stractured line methods. Point triangulation and structured line methods are based on 
the triangulation principle and the laser radar methods are based on the measurement 
of the travel time or phase of either a pulsed or modulated laser. All these techniques 
reqidre eifh^ one-dimensional or two-dimensional scanning of the laser to cover the 
entire surface of the object. This generally makes the systems more sophisticated and 
the measurement more time consuming. 

Typical non-scanning techniques include stereo vision and moir6 
interferometry. Stereo vision obtains three-dimensional information of an object by 
viewing a scene from two different perspectives and then locating common features in 
both images. (Hobrough, G. and Hobrough, T., "Stereopsis for robots by iterative 
stereo image matching," Proc. SPIE, Vol. 449, 62 (1983)). The processing of the 
images is computationally intensive, which makes the technique unsuitable for high- 
speed 3-D contouring. 

Moire interferometry is one of the most commonly used techniques for 3-D 
surface contouring. Compared to other techniques, it has the primary advantage of 
fast measurement speed due to the fact that it does not require scanning to cover the 
whole object surface and the image processing for extracting 3-D contour information 
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is relatively simple. Moire contouring techniques can be classified as either shadow 
moire (Chiang, F. P., "Moire Methods for Contouring, Displacement, Deflection, 
Slope, and Curvature," Proc, SPIE, Vol. 153, 113-1 19 (1978)) or projection moire 
(Khetan, R. P. and F. P. Chiang, "On the theory of two projection moire methods," 
Univ. Of lU. at Chicago press, 8, 16-18 (1977); Halioua, M., Krishnamurthy, R. S., 
Liu, H., and Chiang, F. P., "Projection moire with moving gratings for automated 3-D 
topography," Appl. Opt. 22, 850-855 (1983)). Shadow moire uses the same grating 
for both illumination and observation, while projection moire uses separated gratings. 
Another surface contouring technique is fringe projection which uses only one grating 
and measures surface height by triangulation. 

An advantage of shadow moire is that it is easy to obtain quantitative contour 
information from the moire pattern because the grating is flat and its period known. 
However, the contouring of large objects is difficult because a grating with 
^proximately the same size as the object must be used. Large gratings are difficult to 
make and have limited mobility. 

Projection moire and fringe projection offer advantages in their ability to 
contour large objects and the ease with which phase measuring techniques can be 
implemented to increase the measurement resolution. Their primary limitation is the 
tedium associated with obtaining quantitative height information. This limitation 
arises because it is necessary to caUbrate both the projection geometry and the 
magnification factor. 

In order to increase contouring resolution, phase shifting techniques developed 
in interferometry have been widely adopted and used in moire and fringe projection 
methods for 3-D surface contouring. The resolution of the moire and fringe projection 
contouring methods depends on the density of the fringe projected on the object. 
Generally, higher fiinge density means higher resolution. However, there is a limit to 
the fringe density that can be applied because overly dense fiinges may not be 
resolvable by the camera. To solve this dilenuna, phase shifting techniques have been 
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developed and widely used in optical contouring applications (Halioua, M. and Liu, 
H- -C, "Optical Three-Dimensional Sensing by Phase Measuring Profilometry," Opt. 
Lasers Eng., 11(3), 185-215 (1989); Moore, DT. and Truax, B.E., "Phase-Locked 
Moire Fringe Analysis for Automated Contouring of DifEiise Surfaces," Appl. Opt, 
18(1), 91-96 (1979); Srinivasan, V. H., Liu, H. -C, and Halioua, M., "Automated 
Phase-Measuring Projfilometry of 3-D Diffuse Objects," Appl. Opt, 23(18), 3015- 
3018 (1984); Srinivasan, V. H., Liu, H. -C, and Halioua, M., "Automated Phase- 
Measuring Profilometry of 3-D DilBiise Objects," Appl. Opt., 24(2), 185-188 (1985); 
Boehnlein, A.J. and Harding, K.G., "Adaptation of a Parallel Architecture Computer 
to Phase Shifted Moire Interferometry," Proc. SPIE, Vol. 728, 183-193 (1986); 
Kujawinska, M., "Use of Phase-Stepping Automatic Fringe Analysis in Moire 
Interferometry," Appl. Opt. 26(22), 4712-4714 (1987); Toyooka, S. and Iwaasa, Y., 
"Automatic Profilometry of 3-D DifiRise Objects by Spatial Phase Detection," Appl. 
Opt.,25(10), 1630-1633 (1986)). Phase shifting dramatically increases measurement 
resolution without the need of using high density fringes. Traditional phase shifting is 
accomplished by mechanically shifting a grating to create a series of phase shifted 
fringe patterns. The phase shifted fringe patterns then are processed to extract the 
phase of each pixel of the image using algorithms well known in the art. 

Phase shifted images are generally obtained by mechanically translating a 
grating. The shortcomings are that the system becomes more complicated because of 
the introduction of moving parts into the system and the phase shifting may not be 
accurate due to mechanical errors. The Phase Shifting And Logical Moire (PSALM) 
was proposed to eliminate some of the problems with traditional phase shifting 
techniques (Asundi, A., "Projection moire using PSALM," Proc. SPIE, Vol. 1554B, 
257-265 (1991)). PSALM uses only one grating with the other grating generated by 
software in a computer. The phase-shifted moire fringes are obtained through logic 
calculations on the image of the object and the software created grating. Since no 
moving parts are necessary, this technique greatly simplifies the contouring system. 
The problem with this technique is that ttie contouring result is subject to possible 
errors due to surface reflectivity changes and existing surface marks. Other attempts 



4 



wo 99/34301 PCT/US98/27915 

to simplify the contouring system used a Liquid Crystal Display (LCD) panel as the 
projection system (Asundi, A., "Fringe Analysis in Moire Interferometry," Proc. 
SPIE, Vol. 1554B, 472-480 (1991); Arai, Yasuhiko, Yekozeki, Shunsuke, and 
Yamada, Tomoharu, "3-D automatic precision measurement system by liquid crystal 
plate on moire-topogr^hy," Proc. SPIE,Vol. 1554B, 266-274 (1991)). With the 
creation of the fringe pattern and phase shifting being done by software, the system is 
flexible and simple. However, because of the low image brightness and contrast of 
LCD panels (Sansoni, G., Docchio F., Minoni U., and Bussolati C, "Development 
and characterization of a liquid crystal projection unit for adaptive structured 
illumination Proc. SPIE, 1614, 78-86 (1991)), the quality of the fringe pattern 
reflected from the object is poor which causes errors in extracting surface contour 
information. For this reason, any meaningftil contouring can only be done for small 
objects. 

Another traditional problem associated with the phase-shifting technique is the 
modulo 2% ambiguity caused by the phase extraction process using the arc-tangent 
ftmction which has values only between -7c/2 and 7t/2. Even though with corrections, 
the phase calculation range can be extended to 0 to 27C, the absolute phase still cannot 
be recovered. This means that if the object surface has discontinuous features, such as 
step-like jumps, and the height change causes a phase change exceeding 27i, then the 
phase extraction process caimot provide the correct height information. Accordingly, 
traditional phase shifting technology usually cannot be applied to measure surfaces 
with discontinuous geometric features. To eliminate this problem, a new technique, 
namely, field-shift moire, was proposed (Boehnlein, Albert, and Harding, Kevin G., 
'Tield shift moire, a new technique for absolute range measurement," Proc. SPIE, 
Vol. 1163, 2-9 (1989)). Field-shift moire shifts the whole projection system including 
the grating and the light source to capture a series of field-shifted images. With 
proper mathematical manipulation, both the fiinge order and the phase of each pixel 
can be extracted to yield absolute measurement of the surface contour even for 
prismatic objects with discontinuous features. The problem, however, is the need to 
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siutt the whole projection system in accurate steps, which makes the system even 
more complicated than tiie traditional grating shifting technique. 

When using phase shifting, at least three images, each with certain phase shift, 
must be taken to reconstruct the contour of the object. Traditionally, these phase 
shifted images are takai sequentially which limits the technique only to the 
contouring of static objects. In many engineering applications, 3-D surface 
contotiring of objects under quasi-static or dynamic changes provides critically 
important information about the objects. In such applications, quickly capturing 3-D 
surface contours of objects becomes necessary. There have been some reports on 
using color as a means to boost contouring speed while keeping the resolution intact. 
K.G. Harding "Color encoded moire contouring," SPIE Proc. Vol. 1005 Optics, 
Illumination, and Image Sensing for Machine Vision HI, 169-178 (1988) and 
European Patent No. EP0076866. Harding proposed a color-encoded moire technique 
that retrieves the 3-D surface contour of an object from a single snap shot of the object 
illuminated by a color-encoded fringe pattem. Contouring speed was limited only by 
the frame rate of the camera. However, since the color-encoded fringe pattem 
produced on a Polaroid film had a poor contrast ratio, no actual contouring of objects 
was attempted. 

European Patent No. EP0076866 discloses the simultaneous projection of 
three color-coded patterns on an object with the pattems being phase-shifted by 120 
degrees relative to each other. The grating pattems deformed by the object surface are 
recorded corresponding to their color coding by three associated color-selective 
cameras. As a result of this, the pattem is recorded simultaneously in three different 
phase relations so that an evaluation based on phase shifting algorithms may be 
performed without requiring a mechanical shifting. 

Each of the methods and apparatus described above has inherent shortcomings 
which detract from their use in three dimensional imaging, and it is an object of the 
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present invention to overcome such shortcomings and to provide an improved method 
and apparatus for three dimensional surface contouring. 

SUMMARY OF THE INVENTION 

The present invration is a method and apparatus for three dimensional surfiace 
contouring. The present invention uses a digital video projector for projecting fringe 
patterns in surface contouring. 

The method of three dimensional surface contouring of an object having a 
surface defining a geometry includes generating a plurality of phase shifted digitally- 
interpretable fringe pattem signals with each signal being generated at a separate 
phase angle. The signals are then converted into optical phase shifted fringe patterns 
which are projected onto the surface of the object. The geometry of the object distorts 
the fringe patterns. A reflection of each of the distorted fringe patterns is individually 
retrieved. The distorted fringe patterns are combined to generate a phase-wrapped 
image. The phase-wrapped image is unwrapped to reconstruct the surface of the 
object. 

The apparatus for three dimensional surface contouring of an object includes a 
fringe pattem generator that generates a plurality of phase shifted digitally- 
interpretable fringe pattem signals with each of the signals being generated at a 
separate phase angle. A digital video projector receives the signals from the fringe 
pattem generator. The digital video projector converts the signals into optical fringe 
patterns and projects the fringe pattems onto the surface of the object. The fringe 
patterns are distorted by the geometry of the object and an optical retrieval device 
retrieves a reflection of the distorted fringe pattem. An image generator combines the 
distorted fringe pattems and reconstructs the surface of the object. 

In a preferred embodiment of the invention, at least three phase shifted fringe 
pattems are generated separated by 120 degrees. The phase shifted fringe pattems can 
be projected sequentially. Preferably the sequential projection of the phase shifted 
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fringe patterns is synchronized to increase contouring speed. Contouring speed can 
also be increased by projecting a plurality of phase shifted fringe patterns substantially 
simultaneously by color encoding the phase shifted fringe patterns. The fringe pattern 
generator can be a circuit configured to generate the fringe pattern. The fringe pattern 
generator can be located within the image generator. The fringe pattern generator can 
also include a mechanical phase shifter for shifting the phase angle. Preferably the 
fiinge pattern generator shifts the phase angle digitally. Preferably where there are a 
number of phase shifted fringe patterns, the phase shifted fringe pattems are separated 
by the quotient of 360 degrees divided by the number of phase shifted fiinge pattems. 

As a result of the present invention, a method and apparatus for three 
dimensional surface contouring is provided. A particular advantage is that since the 
fiinge pattems are generated digitally and projected by a digital video projector the 
fiinge pattems have exceptionally high brightness and contrast ratio. In addition, since 
the fiinge pattems are generated digitally, fiinges with any cross-sectional intensity 
profile and spacing can be produced. Further, the digitally controlled phase shifting 
technique eliminates the traditional need for physically shifting a grating or other 
optical components which translates into higher contouring accuracy. Moreover, 
fiinge pattems can now be easily color encoded for a variety of applications. 

For a better understanding of the present invention, reference is made to the 
following description to be taken in conjunction with the accompanying drawings and 
its scope will be pointed out in the appended claims. 

RRTTCF DESCRIPTION O F TTTK DRAWINGS 

Preferred embodiments of the invention have been chosen for purposes of 
illustration and description and are shown in the accompanying drawings, wherein: 

Figure 1 is a perspective view of the surface contouring device of the present 
invention with some of the attributes shown schematically; 
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Figure 2 is a flowchart illustrating an algorithm used by the fringe pattern 
generator; 

Figure 3 is an elevational view of a Digital Mirror Device; 

Figure 4 is a schematic view illustrating the Digital Mirror Device switching 
principle; 

Figure 5 is an exploded perspective view showing a Digital Light Processing 
projection system; 

Figure 6A is a view showing a fringe pattem being projected on a dummy face 
having a phase angle of 0 degrees; 

Figure 6B is a view showing a fringe pattem being projected on a dummy face 
having a phase angle of 120 degrees; 

Figure 6C is a view showing a fringe pattem being projected on a dummy face 
having a phase angle of -120 degrees; 

Figure 7 is a view showing a mask generated to remove noise in the 
background of the phase-wrapped image; 

Figure 8 is a view showing a phase-wrapped image generated from the 
information contained in Figures 6A, 6B, and 6C; 

Figure 9 is a view showing a reconstmcted surface of the dummy face shown 
in Figures 6A, 6B, and 6C; 

Figure 10 is a view showing a color encoded fringe pattem being projected on 
a plaster head sculpture; 
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Figure 1 1 A is a view showing the red channel of the color encoded fringe 
pattern shown in Figure 10 having a phase angle of -120 degrees; 

Figure 1 IB is a view showing the green channel of the color encoded fringe 
pattern shown m Figure 10 having a phase angle of 0 degrees; 

Figure 1 IC is a view showing the blue channel of the color encoded fringe 
pattern shown in Figure 10 having a phase angle of 120 degrees; 

Figure 12 is a view showing a phase-wrapped image generated from the 
information contained in Figures UA, IIB, and II C; and 

Figure 13 is a view showing a reconstructed surface of the plaster head 
sculpture shown in Figures 1 lA, 1 IB, and 1 IC. 
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DETAILED DESCRIPTION OF THE INVENTION 

Initially referring to Figure 1 a surface contouring device 10 in accordance 
with the present invention is shown. The surface contouring device 10 includes a 
fringe pattern generator 16, a digital video projector 18, an optical retrieval device 20, 
and an image generator 22. 

The fringe pattern generator 16 generates a digitally-mterpretable fringe 
pattern signal that is received by the digital video projector 18 for conversion to an 
optical fringe pattern. The fringe pattern generator 16 is capable of generating 
digitally-interpretable fringe pattern signals to produce any type of optical fringe 
pattern including sinusoidal patterns, binary structured-line patterns, and circular 
patterns as known to those skilled in the art. Most importantly, the fringe pattern 
generator 16 can generate a pluraUty of phase shifted digitally-interpretable fringe 
pattem signals for producing a plurality of optical phase shifted fringe patterns 
without the traditional mechanical shifting of a grating by shifting the phase angle 
digitally. The fringe pattem generator 16 can be, for example, any suitable computer, 
processor (e.g., digital signal processor, microprocessor, etc.), microcontroller, or 
circuit configured with the teachings hereof. In experimentation conducted by the 
inventors usmg a computer as the fringe pattem generator 16, the inventors developed 
a Windows based program in Visual Basic and also in Visual C-H- for generating the 
signals with a computer. During their experimentation, the inventors used a keyboard 
and video monitor as an interface for modifying the fringe type, intensity profile, 
spacing, phase, and color. The fringe pattem generator can also use embedded 
circuitry tailored to specific industrial appUcations. 

Referring now to Figure 2, a flowchart illustrating the algorithm used by the 
•fringe pattem generator 16 is shown. Essentially the fringe pattem generator 16 
assigns the intensity, /, and color for each pixel of the digital video projector 1 8. 
Referring to input block 23, initially the phase angle A, pitch color, and an array of 
pixels m :c rt of the digital video projector for projecting the fringe pattem are selected. 
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If color encoding of the fringe pattern is desired, the intensities are determined as 
shown m block 25 where I/x), I/x), and IJx) are the intensities of red, green, and blue 
tiiat are assigned to each line or circle of pixels. Notice that //xj, IJx). andlf,(x) are 
each phase shifted by 271/3 or 120 degrees. A mathematical formula for a sinusoidal 
fringe pattern is shown in block 25 by way of example only as it is contemplated that 
fringe patterns having other intensity profiles could be used as well, e.g., triangular. If 
a single color fringe pattern is to be generated, the intensity profile is determined next. 
Again by way of example only blocks 27, 29, and 31 include formulations for 
sinusoidal, triangular and binary intensity profiles respectively that are commonly 
used by those skilled in the art. Blocks 33, 35 and 37 illustrate examples of generating 
red, grayscale, and green fringe patterns respectively. Fringe patterns of other colors 
can be generated in a similar manner. The fringe type is selected next. As shown in 
blocks 39 and 41 fringe patterns are generally linear or circular, but could be arranged 
in any desired form. The process of assigning each pixel an intensity and color is 
r^eated until the array m jc n is completed. 

Although it is preferable to phase shift digitally with the fringe pattem 
gen^tor 16 as discussed above, in an alternative embodiment of the preset 
invention the sqpparatus can further comprise a mechanical phase shifter for shifting 
the phase angle. Traditional mechanical phase shifters generally include motors to 
either translate a grating or the object being imaged, or rotate a glass plate that refracts 
the projected fringe pattem. Examples of mechanical phase shifters are found in U.S. 
Patent Nos. 4,641,972 to Halioua et al., 4,984,893 to Lange, and 5,561,526 to Huber 
et al., the disclosures of which are incorporated herein by reference. 

Referring now to Figure 1, the digital video projector 18 receives the digitally- 
interpretable fringe pattem signal generated by the fringe pattern generator 16 and 
converts the signal into an optical fringe pattem and projects it onto the surface 14 of 
the object 12. Examples of phase shifted fringe patterns are shown in Figures 6A, 6B, 
and 6C which have phase angles of 0, 120 and -120 degrees respectively. The 
projected fimge pattem is then distorted by the geometry of the object 12. Preferably, 
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the digital video projector 18 uses the Digital Light Processing (DLP) wifli Digital 
Micromirror Device (DMD) technology recently developed by Texas Instruments 
Incorporated. (Gove, R.J., "DMD Display Systems: The Impact of an All-Digital 
Display," Society for Information Display International Symposium (1994); 
Hombeck, Larry. J., "Deformable-Mirror Spacial Light Modulators," Proc. SPIE, Vol. 
1150.(1989); Hombeck, Lany, J., "Current status of the digital micromirror device 
(DMD) for projection television appUcations," DEDM 15.1.1 (1993); Hombeck, Larry, 
J., "Digital Light Processing and MEMS: Timely Convergence for a Bright Future," 
available at http://www.ti.com (1996); Monk, D., "Digital Micromirror Device 
Technology for Projection Displays," EID Exhibition & Conference (Sandown,UK 
1994); SampbelU J.B., "The digital micromirror device," Proceedings of the 7th 
ICSS&A (Yokohama, Japan 1993); Sampbell, J.B., "An Overview of the perforaiance 
Envelope of Digital Micromirror Device Based projection Displays," SID Digest, 
669-672 (1994); and Younse, J.M., "Mirror on a chip," IEEE Spectrum, 30(1 1),27 
(1993)(all of which are incorporated herein by reference)). The Digital Light 
Processing (DLP) with Digital Micromirror Device (DMD) technology provides the 
benefits of high bri^tness, contrast ratio, and image quality when used in three- 
dimensional surfece imaging. A brief overview of the DLP technology with reference 
to Figures 3 to 5 follows below. 

Referring now to Figure 3, the Digital Micromirror Device (DMD) 24 is a 
digital light switch integrated circuit having an upper surface that comprises an array 
of tiny square aluminum pixel noirrors 26. Each pixel mirror 26 of the DMD 24 can 
be digitally controlled to reflect incident light into or out of an aperture of a projection 
lens 28 as shown in Figure 4. Figure 4 which is adopted from "Digital Light 
Processing and MEMS: Timely Convergence for a Bright Future," illustrates the 
optical switching action of the mirror. When the pixel mirror 26 rotates to its on state, 
+ 10 degrees, light 30 from an illuminator 32 is directed into the projection lens 28 
and the pixel 34 appears bright on a projection screen 36. When the pixel miixor 26 
rotates to its off state, - 10 degrees, light 30 from the illuminator 32 is directed away 
from the projection lens 28 and the pixel 34 appears dark. Each pixel mirror 26 is 
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capable of switching more than 1,400 times a second and yields a potential of 256 
gray levels providing for the rapid direction of light into or out of the projection lens 
28. 

Referring now to Figure 5 which is also adopted from "Digital Light 
Processing and MEMS: Timely Convergence for a Bright Future," an example of a 
typical DLP projection system 38 is shown. The DLP projection system 38 includes 
an illuminator 32 which is preferably a metal halide lamp. The illuminator 32 
produces white light which is passed through a condenser lens 40 for collecting the 
light and imaging it on a rotating color wheel 42. The color wheel 42 is generally 
segmented into at least a red, a green, and a blue portion, which can be used to project 
these components of colored light to produce over 16 million colors. A second lens 
44 collects the light that passes through the color wheel 42 and evenly illuminates the 
siirface of the DMD 24. Depending on the rotational state of each pixel mirror 26 
(+10 or -10 degrees) of the DMD 24 which are controlled by a DLP circuit board 46, 
tiie light is directed either mto or away from the projection lens 28. The projection 
lens 28 then projects an enlarged image on to a projection screen 36. A variety of 
digital video projectors 18 that use the DLP technology are presently commercially 
available. Some of the manufecturers include Davis North America, Inc., NEC 
Technologies Inc., CTX Opto Inc., and In Focus Systems. In the experimentation 
described herein, the inventors used the LitePro 620 as manufactured by In Focus 
Systems, WUsonville, Oregon. 

Referring now to Figure 1, the optical retrieval device 20 retrieves a reflection 
of the distorted fringe patterns from the surface of the object 12. The optical retrieval 
device 20 is focused at a different angle than the digital video projector 18 with 
respect to the surface 14 of the object 12 for the retrieval of the reflection of the 
distorted fringe pattem. The optical retrieval device 20 can be any electronic camera, 
such as a CCD, CMOS, or Vidicon camera or fihn. Preferably the optical retrieval 
device 20 is a charge coupled device (CCD). A suitable camera for use with the 
teachings hereof is the Kodak Megaplus Model 4.2i having a charge-coupled device 
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airay of 2029(H) x 2048(V) pixels providing for the measuring of over 4 million data 
points simultaneously. 

The image generator 22 combines the distorted phase shifted fringe pattems 
and reconstructs the surface 14 of the object 12. The image generator 22 can be, for 
example, any suitable computer, processor (e.g., digital signal processor, 
microprocessor, etc.), microcontroller, or circuit configured with the teachings hereof. 
As illustrated in phantom in Figure 1, the image generator 22 and the fringe pattem 
generator 16 can be located within the same housing, e.g., a computer. The 
reconstruction of the surface of the object is accomplished by using any of the 
traditional algorithms known from phase shift interferometry to first combine the 
information from the phase shifted fringe pattems to acquire a phase-wrapped image 
and then xmwrap the phase-wrapped image to reconstruct the surface 14 of the object 
12. An example of a phase-wrapped image is shown in Figure 8 which was generated 
from the phase shifted images shown in Figures 6A, 6B, and 6C. 

Initially, the image generator 22 extracts the phase of each pixel of the image 
to be generated. There are a variety of algorithms that are well known in the art for 
obtaining the phase. These algorithms include the three-step (Gallagher, J. E. and 
Herriott, D.R., "Wavefront measurement," U.S. Patent 3,694,088 (1972); Creath, K, 
"Phase-Measurement Interferometry Techniques," in Progress in Optics. Vol XXVI, 
E. Wolf, Ed., Elsevier Science Publishers, Amsterdam, 1988, pp. 349-393), four-step 
least-squares (Bruning, J. H., Herriott, D.R., Gallagher, J.E., Rosenfeld, D.P., White, 
A. D., and Brangaccio, D, J., "Digital Wavefront Measuring Interferometer for 
Testing Optical Surfaces and Lenses," Appl. Opt, 13, 2693 (1974); Greivenkamp, J. 

"Generalized Data Reduction for Heterodyne Interferometry," Opt. Eng., 23, 350 
(1984)), the Caire method (Caire, P., "Installation et Utilization du Comparateur 
Photoelectrique et Interferentiel du Bureau International des Poids de Measures," 
Metrologia 2, 13 (1996)), averaging 3+3 (Schwider, J. Burow, R., Elssner, K. E., 
Grzanna, J.. Spolaczyk, R., and Merkel K„ *T>igital Wavefront Measuring 
Interferometry: Some Systematic Error Sources," Appl. Opt, 22, 3421 (1983); Wyant, 
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J,C. and Prettyjohns, K. N., "Optical Profiler Using Improved Phase-Shifting 
Interferometry" U.S. Pat. 4,639,139 (1987)), the Hariharan method (Hariharan, P., 
Oreb, B. F., and Eiju, T., 'T)igital Phase-Shifting Interferometry: A Simple Em^r- 
Compensating Phase Calculation Algorithm," Appl. Opt., 26, 2504 (1987)), and 2+1 
(Angel, J. R. P. and Wizinowich, P. L., "A Method of Phase-Shifting in the Presence 
of Vibration," European Southern Observatory Conf. Proc, 30, 561 (1988); 
Wizinowich, P. L., "System for Phase-Shifting Interferometry in the Presence of 
Vibration," Proc. SPIE, 1164, 25 (1989); Wizinowich, P. L., 'Thase-Shifting 
Interferometry in the Presence of Vibration: A New Algorithm and System," Appl. 
Opt., 29, 3271 (1990)) algorithms. The aforementioned cited disclosures for 
obtaining the phase angle are incorporated herein by reference. 

In the three-step algorithm, three phase shifted patterns are generated with 
each phase shifted pattern being generated at a separate phase angle. Preferably, the 
phase shifted pattems are separated by 120 degrees (27t:/ 3). Where A„ Aj, and A3 
represent the separate phase angles, the intensity of each pixel in the three pattems can 
be represented as follows: 



where V(x,y) is the average intensity, V(x,y) is the mtensity modulation, and 4> (x,y) is 
the phase to be determined. Solving the above three equations simultaneously for 
^(x,y) yields the following solution: 



Ii(x,y) ^f(x,y)+r{x,y)cos[^(x,y)-hA,] 
l2(x,y) ^I'(x.y)'^r{x.y)cos{^{x,y)+L^^ 
hix,y) ^r(x.y)^r{x,y)co^mx.y)^L;[, ' 



(1) 
(2) 
(3) 



tan<|)(x,j/) = 



(7^ -/p cos A^ ^ (/^ -/p cos A^ ^ (/^ -7^) cos A3 
(73 -7p sinA^ + (7j -7^) sin A^ + (7^ -7^) sinAj 



(4A) 
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By using phase shifts. A, of 120 degrees with A, 
the equation reduces down to: 



(j)(x.^)=tan" 



PCT/US98/27915 

-120, A2 = 0,andA3 = 120, 

(4B) 



With the signs of (/j -I^) and (2/2- A -^3) known, the above equation provides the so- 
called modulo 2n phase at each pixel with values between 0 and 27T. Once ^(x,y) for 
each pixel is determined, a saw-tooth-like phase-wrapped image can be generated 
with the highest gray level corresponding to the phase of 27i; and the lowest to 0. 
More than three phase shifted patterns can be generated and used in determining 
^(x,y) for each pixel which generally translates into higher accuracy. However, the 
trade-off is longer processing time both in image retrieval and processing. In 
addition, the average intensity r(x,y), intensity modulation r(x,y)y and data 
modulation Y(^*y) ^® derived as follows: 



(5) 
(6) 



The Data modulation y(x.y) can be used to check the quality of data at each pixel A 
data modulation near one is good, whereas a data modulation near zero is bad 
meaning the ftinges are washed out, saturated, out of focus, etc. Alternatively, the 
solutions for Equations (1) through (3) for Ae phase, the average intraisity, intensity 
modulation, and data modulation can be determined by Fourier coefficients as 
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suggested in U.S. Patent No. 3,694,088 to Gallagher et al., the disclosure of which has 
been previously incorporated herein by reference. 

The image generator 22 extracts the height information from the phase- 
wrapped image using a standard phase unwrapping algorithm. There are a variety of 
algorithms that are well known in the art for unwrapping the phase-wrapped image. 
General methods for unwrapping the phase-wrapped image are described in *Thase 
Shifting Interferometry," in Optical Shop Testing, by J.E. Greivenkamp and J.H. 
Bruning, 2d Ed., Daniel Malacara, John Wiley & Sons (1992) at pages 551-553. In 
addition, U.S. Patent No. 5,307,152 to Boehnlein et al., the disclosure of which is 
incorporated herein by reference, discloses an algorithm (Col. 7, line 7 through Col. 8, 
line 43) for unwrapping a phase- wrapped image that was generated with Equation 
(4A) with phase shifts of 90 degrees. 

In experimentation conducted by the inventors, the 2tz discontinuity is first 
removed horizontally as follows: 

f/x,y)^^(x,yj+2nk, (8) 
where k is the nimiber of 2ii's that needs to be added in order to remove the 
discontinuity. The nimoiber k can be positive or negative depending on the geometry 
of the surface. The application of Equation (8) to the phase-wrapped image provides a 
series of horizontal surface profiles that are not height related. In order to form a 
continuous surface, the height relations of the horizontal surface profiles needs to be 
determined. Assuming that the pixel number is Mx N, this is accomplished by 
removing the 2it discontinuity vertically for the middle column as follows: 

fyfMay) = (^(M/2.y) -f 27r/, (9) 
where / is the number of 2^1 's that need to be added in order to remove the 
discontinuity vertically. The middle column vertical profile provides the height 
relations for the series of horizontal profiles generated by Equation (8), The final 
surface contour can be obtained by the following equation: 

f(x.y) = {f/x.y) ^f/M/2.y) - s^] + \fy (M/2.y) -/^ (MaN/2) - s^l (10) 
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where 

= (M.N/2) -/x(0,M2)]/M, (1 1) 

5y = \fy{MI2M) 'fy {MlimK (12) 
are the slopes of the middle row and the middle column respectively. The slopes are 
included in the equation to remove the tilt of the surface contour. 

The above algorithm is premised upon the object occupying the entire image. 
If the object occupies only part of the image as shown in Figure 6A, 6B, and 6 C, then 
a mask is generated to define the boundaries of the object removing the noise in the 
background as shown in Figure 7. The mask in Figure 7 was generated by taking the 
average of the three reflected phase shifted fringe patterns and binarizing the average 
at a gray level of 20. The algorithm is modified to do phase unwrapping only within 
the boundaries of the object 

The operation of the embodiment of the invention shown in Figure 1 along 
with a method of the invention will now be described in detail with reference to 
Figures 6A, 6B, 6C, 7 and 8 which illustrate the reconstruction of a dummy face. 
Initially, digitally-mterpretable fringe pattOTi signal is generated with the fringe 
pattern generator 16. The signal is converted into an optical phase shifted fringe 
pattem and projected onto tiie surface 14 of the object 12 being imaged as shown in 
Figure 6 A. The fringe pattem is distorted by the geomeny of the object and the 
reflection of this distorted fringe pattem is retrieved by the optical retrieval device 20 
which forwards the reflection to the image generator 22. The phase angle is shifted 
after the optical retrieval device 20 retrieves the reflection and the process is repeated. 
Generally, when the three-step algorithm described above is used, a total of three 
phase shifted signals are generated. The phase angles of Figures 6A, 6B, and 6C are 
separated by 120 degrees. The image generator 22 combines the distorted fringe 
patterns to generate a phase-wrapped image as shown in Figure 8 by extracting the 
phase of each pfacel of the unage as described above. In generating the phase-wrapped 
image shown in Figure 8 noise in the background was removed by masking the 
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boxmdaries of the object as shown in Figure 7. Once the phase-wrapped image is 
generated, the image generator 22 reconstructs the surface 14 of the object 12 by 
unwrapping the phase-wrapped image. 

In an alternative embodiment of the invention, the phase shifted fringe patterns 
are color encoded and projected substantially simultaneously. The inventors' initial 
experimentation using color encoding is described in SPIE Proceedings Vol. 3407, 
Paper No.: 3407-66, pp.477-482 entitled "Color-encoded fringe projection and phase 
shifting for 3D surface contouring" published on September 29,1998, the disclosure of 
which is incorporated herein by reference. This embodiment of the invention will be 
explained with reference to Figures 10 through 13, which show images that were 
generated in reconstructing the three dimensional surface contour of a plaster 
sculpture of a head. 

Referring now to Figures 1, in this embodiment the fringe pattern generator 16 
generates substantially simultaneously a plurality of phase shifted digitally- 
interpretable fringe pattern signals that are color encoded. When the three step 
algorithm is used for phase wr^ing, preferably three signals are generated. The 
signals are encoded with information so that the optical fringe patterns are phase 
shifted by 120 degrees with each one having a separate color, e.g., red, green, and 
blue. Essentially, the fringe pattern generator 16 generates a signal containing the 
information of three phase shifted patterns superimposed, but color encoded for 
identifying the separate phase shifts for image reconstruction. 

The digital video projector 18 receives the superimposed color encoded signal 
and converts the signal into a color encoded optical fringe pattem and projects it onto 
the surface 14 of the object as shown in Figure 10. The fringe pattem shown in Figure 
.10 includes the three phase shifted components shown in Figures 1 1 A, 1 IB, and 1 IC. 
In using digital video projectors that are currently commercially available, color can 
be added by three different mechanisms. Where a projector has only one DMD chip 
as described above with reference to Figure 5, the color is added by the use of a 
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rotating RGB color wheel. In projectors that have two DMD chips, one chip is 
dedicated to red and the other chip to green and blue. A color wheel with yeUow and 
magenta filters is used to provide a continuous red beam and an altCTiating green and 
blue beam. In three-chip projectors, a DMD chip is dedicated for red, green, and blue. 
As expected the three-chip system provides the best light efficiency, but is also the 
most expensive. When using a three-chip projector the three phase shifted 
components shown in Figures 1 1 A, 1 IB, and 1 IC can truly be projected 
simultaneously. When using a single-chip projector that uses the rotating color wheel, 
the three phase shifted components are also projected simultaneously with each 
componrait being intermittaitly projected. The intermittent projection is dependent 
upon the location of the rotating color wheel with respect to the light being passed 
th^through. 

When using color encoded fringe patterns, the optical retrieval device 20 is a 
color camera. Preferably, the optical retrieval device 20 is a three-CCD color video 
camera providing high resolution because each CCD can be dedicated to one color 
channel. The optical retrieval device retrieves the reflection of the optical fringe 
pattern shown in Figure 10. In the inventors' experimentation, a digital camera from 
Kodak (Model DC210) which has 1 152 x 864 pixels was used. The camera has a 
color CCD sensor that produces color images based on a filter array technique that has 
50% of the pixels filtered for green and 25% each for red and blue. There are more 
pixels filtered for green than those for red and blue because human eyes are most 
sensitive to green. The reflections retrieved by the camera were transferred to an 
im^e generator 22 using Kodak's Easy Picture software. 

The image generator 22 first separates the reflection shown in Figure 10 into 
its RGB components as shown in Figures 1 1 A, 1 IB, and 1 1 C. After the RGB 
components are acquired, the RGB components are combined through the standard 
phase wrapping and unwrapping algorithms described above, but with modifications 
for color coupling and color intensity as discussed below. In the inventors' 
experimentation, Aldus PhotoStyler image processing software was used to separate 
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the RGB components of the reflection. The modifications discussed below relate to 
the specific experiments conducted by the inventors. As the discussion wU highlight, 
those skilled in the art will understand that similar modifications may be necessary, 
but will depend upon the specific application of the invention. 

Since the color encoding technique requires that the reflection be separated 
into RGB components, the outcome of contouring is dependent upon the quality of the 
separation. Generally in all color cameras, the spectra of red, green, and blue channels 
are usually made to have some overlaps so that there will be no color-blind areas on 
the spectrum. This implies that the complete separation of the three phase shifted 
fringe patterns is not likely. However, since the degrees of overlaps are fixed, 
compensation for the coupling effects can be done after the image has been taken. 
Experiments were conducted to find the degree of coupling effects between the three 
color channels. The target used for this experiment was a flat, white-painted foam 
board. Purely red, green, and blue fiinge patterns were projected in sequence. For 
each color, three phase shifted images (-27c/3, 0, 2n/3) were taken which resulted in a 
total of nine images. The images were then separated into their RGB components, 
which resulted in a total of 27 images. From these images, the intensity modulation 
r'(x,y) was calculated according to Equation (6) for each set of the phase-shifted 
images. The ratios of r(x,y) values between channels indicated the degree of 
coupling effects between these channels. It was determined that there was a strong 
coupling effect between the red and green channels, but a much weaker one between 
the green and blue channels. The strong coupling effect between the red and green 
channels cannot be attributed to the overlap of spectra of the two colors alone. Color 
distortion by the projector and the camera may have caused the major part of it 
because when comparing the red or green fiinge pattem projected on the object and 
with that on a video monitor, a difference in color was noted. To compensate for this 
coupling effect, the following equations were used to calculate the compensated 
intensities: 

IrJix.y) = UJix,yy al,(xyn I {l-ab) + c. (13) 
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where IX^,y), I/x,y) and are the original intensities and IrX^,y\ I^X^,y\ and 

IiJix,y) are the compensated intensities for the red, green, and blue channels, 
respectively, a and b represent coupling eflfect between the red and green channels, 
and c is the offset that is necessary to keep the intensity values between 0 and 255. 
The coupling effect between the green and blue channels was ignored. Experimental 
results showed that this compensation scheme reduced the errors caused by the 
coupling effect significantly. 

In addition to the coupling effects between the color channels, a correction for 
an intensity imbalance between the images of the red, green, and blue fringe pattems 
may be required. In the experimentation, red was the weakest and green was the 
strongest. Since the input intensities for the three colors were the same (255 levels), 
this imbalance was caused mostly by the digital video projector, which used a metal 
halide lamp that is red-light deficient To compensate for this imbalance, the 
amplitudes of the fringe pattems for the three colors was adjusted. It was determined 
that changing the amplitude for the green and blue colors to 210 and keeping the 
amplitude for the red color at 255 produced the best results. 

In sunraiary, when color encoding is used, only one reflection of the object is 
required to obtain its three dimensional contour thus increasing contouring speed. 
Figure 10 shows the reflection of the color encoded optical fringe pattern wherein the 
amplitudes for the three colors are adjusted as described above. Figures 1 1 A, I IB, 
and 1 IC show the three phase shifted RGB components extracted from Figure 10 
before compensation for the coupling effect. Figure 12 shows the phase-wrapped 
image that was generated after compensation for coupling effects, and Figure 13 
shows the reconstructed 3-D image of the object that was only unwrapped in the area 
enclosed in the central rectangle shown in Figure 12. 
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In another embodiment of the invention, the sequential projection of the phase 
shifted fringe patterns are synchronized to increase contouring speed. To accompUsh 
the synchronization the apparatus of the invention as shown in Figure 1 further 
comprises a synchronizing link 48 which connects the fringe pattern generator 16 to 
the image generator 22. The synchronizing link 48 can simply be a connection that 
provides for the coordination between the initial generation of the digitally- 
interpretable fringe pattern signal and the retrieval of the reflection of each distorted 
fringe pattem. This connection can be either be software based or be embedded in the 
circuitry of either the fringe pattem generator 16 or the unage generator 22* 

Altematively, a unique operating principle of a single DMD chip digital 
projector 1 8 as shown in Figure 5 can be used to control the synchronization. Initially 
a plurality of phase shifted digitally-interpretable fringe pattem signals that are color 
encoded are generated by the fringe pattem generator 1 6. When sent to the digital 
projector 1 8, the RGB components of this color encoded fringe pattem signal will be 
projected sequentially and repeatedly at a frequency of 60 Hz. Referring again to 
Figure 5, if the color wheel 42 of the projector is disengaged, the RGB components of 
the fringe pattem will actually be projected in grayscale. By synchronizing image 
retrieval with the projection of these three component fringe patterns, three phase- 
shifted images of the object can be taken in a very short period, thus boosting up the 
three dimensional imaging speed significantly. Hardware based image processing and 
graphics display can also be used to increase the speed of three dimensional 
reconstmction so that three dimensional imaging at the video rate (30 frames/sec) can 
be realized. 

The present invention also contemplates that the image generator 22 can be 
connected to or include an output device for the display or fiirther consideration of the 
imaging results. More specifically, the output device can include a video monitor or 
printer for simply displaying the results of the imaging. On the other hand, in quality 
control applications where the invention is used for the inspection of industrial parts 
whose parts need to be checked against their design specifications dxiring or after 
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manufacturing, the image can be compared against a mathematical model of the 
standard part to determine whether there are any defects in the manufactured part. In 
addition, when an industrial part is determined to have defects the image generator 22 
can be linked to the fringe pattern generator 16 to generate a signal so that the digital 
video projector 18 projects information concerning defects. The information 
concerning the defects can include for example the nature, severity, and area of the 
defects. The information can also be projected in a variety of ways including: 
projecting the location of the defects on the part that is being imaged; projecting text 
describing the defects; projecting colors on the surface of the object; and projecting 
icons that have a meaning defined by the user. A specific example where the 
invention can be used for inspection purposes is in the sheet metal manufacturing 
industry. The invention can also be used in the assembling processes of sheet metal 
parts which are clamped at various positions. Wrong clamping positions can cause 
large deformations in the sheet metal parts. With the present invention, the 
deformation of the sheet metal part can be inspected quickly after clamping and the 
results can be projected on to the sheet metal surface. The clamping positions can 
then be adjusted until optimal positions are located. 

In another embodiment of the invention, the optical projected fringe patterns 
are optimized to improve surface contouring. In surface contouring by moire 
interferometry or fringe projection the resolution is generally dependent upon fringe 
spacing and contrast in the fringe pattern reflected from the object surface. Since 
fiinge spacing and contrast ui the reflected fiinge pattern dqjend on the slope and 
reflectivity of the surface of the object, the spacing and contrast of the projected fiinge 
pattem should be optimized based on the condition of the surface in order to achieve 
optimized contouring results. In traditional methods, the spacing and contrast are 
assigned one value for the entire surface that is being imaged. With the present 
invention, the object being imaged can be initially reconstructed as described above. 
The image generator 22 then determines the optimal fringe spacing and contrast based 
upon the initial reconstructed image and through a link to the fiinge pattem generator 
16 adjusts, the fringe pattem signal accordingly. A second reconstructed image is then 
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obtained using the adjusted fringe pattern signal. In another embodiment, the image 
generator 22 first divides the reconstructed image into a plurality of separate areas 
with each area being characterized in that it requires a similar fringe pattern for 
optimal surface contouring. The image generator 22 then assigns each area its optimal 
fringe spacing and contrast. A second reconstructed image is obtained as described 
above. In an alternative embodiment, ttie image generator 22 first generates a 
duplicate of the reconstructed image. The reconstructed image is divided into a 
plurality of separate areas with each area being characterized in that it requires a 
similar fringe spacing for optimal surface contouring. The duplicate of the 
reconstructed image is divided into a plurahty of separate areas with each area being 
characterized in that it requires a similar fringe contrast for optimal surface 
contouring. The image generator 22 then superimposes the results to assign the entire 
surface both its optimal fiinge spacing and contrast. A second reconstructed image is 
obtained as described above. The optimizing steps in all embodiments can be repeated 
as required, but it is expected that only one iteration is necessary for most 
appHcations. 

In another embodiment of the invention, the fringe pattem is ordered to 
address the problems associated with discontinuities in the surface of the object. In 
one method, prior to projecting the fiinge patterns, a single fiinge is digitally 
projected and scanned throu^ the surface of the object While scanning, a plurality 
of reflected images are retrieved to locate the position of areas with discontinuous 
features. The reconstruction of the surface is then done in accordance with the 
invention as described above, but with one fringe encoded with a different color or 
intensity running through each area identified as having a discontinuous feature. The 
encoded fiinge is now used to reference fiinges from which the remaining fiinges are 
ordered. The additional information known from the fiinge order is used in phase 
unwrapping to correctly reconstruct any discontinuous features in the surface of the 
object. In an alternative method, all of the fiinges of the fiinge pattem are color 
encoded with a plurality of different colors forming a fringe pattem that is similar to a 
rainbow. The rainbow pattem can be periodically repeated at a sufBcient spacing to 
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insure that there is no overlapping of similar colors. Each fringe can now be ordered 
on the basis of its rainbow color profile so that any discontinuous features in the 
surface of the object can be correctly reconstructed during phase unwrapping. 

In anoflier method for addressing the problems associated with discontinuities 
in the surface of the object, a first surface contour is initially extracted by 
triangulation as known in the art from a plurality of reflected images acquired by 
projecting and scanning a single fringe through the surface of the object. Since only 
one image exists in each image, there is no fringe order confusion nor modulo 2tc 
ambiguity problem. The surface contour obtained through triangulation is correct, but 
the tradeoff is that it provides low resolution. A second surface contour is now 
obtained using the phase shifting m^ethod which provides a high resolution of the 
surface contour but cannot extract the correct height information at surface 
discontinuities. Once both surface contours are obtained the image generator 
combines the information from both images to provide a surface contour having high 
resolution and correct height information at discontinuities. 

In another embodiment of the invention, the fringe pattern gmerator 16 is 
configured to gmerate a plurality of digitally-interpretable signals so that the digital 
video projector 18 projects a plurality of spots or cross-hairs at various points on the 
surface of the object for determining range information- To determine the range 
information, initially at least three spots or cross-hairs are projected onto separate 
points on the object. The spots or the centers of the cross-hairs are retrieved by the 
optical retrieval device 20 and using the principles of triangulation the distance to 
each point is determined by the image generator 22. The distance information of at 
least three points on the surface combined with the surface shape obtained by the 
phase shifting method uniquely determines the absolute position, orientation, and 
shape of the object surface in space. This measurement of absolute position, 
orientation, and shape is useful, for example, in providing 360-degree measurement of 
object surface where patches of object surface measured at different angles need to be 
connect'^d to form a seamless 360-degree shape. 
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Thus, while there have been described what are presently believed to be the 
preferred embodiments of the invention, those skilled in the art will realize that 
changes and modifications may be made thereto without departing &om the spirit of 
the invention, and is intended to claim all such changes and modifications as fall 
within the true scope of the invention. 
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1 . A method of providing a three-dimensional data-bearing fringe pattern on a 
surface of an object, said method comprising the steps of: 

(a) generating a digitally-interpretable fringe pattem signal; 

(b) converting said signal into an optical fringe pattem; and 

(c) projecting said fringe pattem onto said surface of said object. 

2. An apparatus for projecting a fringe pattem onto a surface of an object, said 
apparatus comprising: 

a fringe pattem generator for generating a digitally-interpretable fringe pattem 
signal; and 

a digital video projector connected to said fringe pattem generator for 
receiving and converting said signal into an optical fringe pattem and projecting said 
fringe pattem onto said surface of said object. 

3 . An apparatus for projecting a fringe pattem as defined in Claim 2, wherein 
said fringe pattem generator is a circuit configured to generate said fiinge pattem. 

4. An apparatus for projecting a fiinge pattem as defined in Claim 2, wherein 
said fiinge pattem generator is a computer programmed to generate said fiinge 
pattem. 

5 . A method of three dimensional surface contouring of an object having a 
surface defining a geometry, said method comprising said steps of: 

(a) generating a digitally-interpretable fiinge pattem signal; 

(b) converting said signal into an optical fringe pattem; 

(c) projecting said fiinge pattem onto said surface, said fiinge pattem 
being distorted by said geometry of said object; and 

(d) retrieving a reflection of said distorted fiinge pattem with an optical 
retrieval device. 
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6. An ^paratus for three dimensional surface contouring of an object having a 
surface defining a geometry, said apparatus comprising: 

a fringe pattem generator for generating a digitally-interpretable fringe pattem 
signal; a digital video projector cormected to said fringe pattem generator for 
receiving and converting said signal into an optical fringe pattem and projecting said 
fringe pattem onto said surface where said fringe pattem is distorted by said geometry 
of said object; and 

an optical retrieval device for retrieving a reflection of said distorted fringe 

pattem. 

7. A method of three dimensional surface contouring of an object having a 
surface defining a geometry, said method comprising the steps of: 

(a) generating a plurality of phase shifted digitally-interpretable fringe 
pattem signals, each of said signals being generated at a separate phase angle; 

(b) converting said signals into optical phase shifted fringe patterns; 

(c) projecting said fringe patterns onto said surface, said fringe patterns 
being distorted by said geometry of said object; 

(d) retrieving a reflection of each of said distorted fringe patterns 
individually; 

(e) generating a phase-wrapped image by combining said distorted fringe 
patterns; and 

(f) reconstracting said surface of said object by unwrapping said phase- 
wrapped image. 

8. A method of three dimensional surface contouring as defined in Claim 7, 
wherein at least three phase shifted fringe patterns are generated separated by 120 
degrees. 

9. A method of three dimensional sxirface contouring as defined in Claim 7, 
wherein each of said phase shifted fiinge pattems are projected sequentially. 
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10. A method of three dimensional surface contouring as defined in Claim 7, 
wherein said plurality of phase shifted fringe patterns arc color encoded and projected 
substantially simultaneously. 

11. An apparatus for three dimensional surface contouring of an object having a 
surface defining a geometry, said apparatus comprising: 

a fringe pattem generator for generating a pluraUty of phase shifted digitally- 
interpretable fringe pattem signals, each of said signals being generated at a separate 
phase angle; 

a digital video projector connected to said fringe pattem generator for 
receiving and converting said signals into optical fringe patterns and projecting said 
fringe patterns onto said surfrice where said fringe patterns are distorted by said 
geometry of said object; 

an optical retrieval device for retrieving a reflection of said distorted fringe 
patterns; and 

an image generator which combines said distorted fringe patterns and 
reconstructs said surface of said object. 

12. An apparatus for three dimensional surface contouring as defined in Claim 1 1 , 
wherein said fringe pattem generator is a circuit configured to generate said fringe 
pattem. 

13. An apparatus for fliree dimensional surface contouring as defined in Claim 1 1 , 
wherein said fringe pattem generator comprises a circuit located within said image 
generator and programmed to generate said fiinge pattem. 

14. An apparatus for three dimensional surface contouring as defined in Claim 1 1 , 
wherein said fringe pattem generator further comprises a mechanical phase shifter for 
shifting said phase angle. 
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15. An apparatus for three dimensional surface contouring as defined in Claim 1 1, 
wherein said fringe pattern generator shifts said phase angle digitally. 

16. An ^paratus for three dimensional surface contouring as defined in Claim 1 1, 
wherein each of said phase shifted fiinge patterns are projected sequentially. 

1 7. An apparatus for three dimensional surface contouring as defined in Claim 1 1, 
whereia said plurality of phase shifted fringe patterns are color encoded and projected 
substantially simultaneously. 

1 8. An apparatus for three dimensional surface contouring as defined in Claim 1 1, 
wherein Aere are three phase shifted friage patterns separated by 120 degrees. 

19. An apparatus for three dimensional surface contouring as defined in Claim 11, 
wherein there are a number of phase shifted fiinge patterns which are separated by the 
quotient of 360 degrees divided by said number. 

20. An apparatus for three dimensional surface contouring as defined in Claim 1 1, 
fiirther comprises a synchronizing link connecting said fiinge pattern generator to said 
image generator to increase contouring speed. 
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